12 Transformation of RVs 1-dim

1 Introduction

Consider a probability space (Ω,F,P). A RV X:ΩRXRn and a T:RXRYRm. We can compound them to T(X):ΩRY.
Pasted image 20241201112923.png|350

Technical detail: T needs to be a measurable function.

So we have measurable spaces (RX,ΣX),(RY,ΣY) (Σ is the σ -algebra)
For all AΣY, require T1(A)ΣX. Here T1(A) is the preimage of A.

We want to know what the distribution of Y=T(X) is.

Change of Variable Principle:
For a given T, the distribution of T(X) is determined by the distribution of X.
For ARY (technically AΣY), P(T(X)A)=P({ωΩ|T(X(ω))A})=P({ωΩ|X(ω)T1(A)})(1.1)=P(XT1(A)).

For continuous RV, it is always P(Y=y)=0.

2 Invertible Transformation

In general, if T is invertible and T1 is differentiable, the p.d.f of Y=T(X) is given by (1.2)fY(y)=fX(T1(y))|dT1(y)dy|.

3 Many-to-One Transformation

Now we see a case of non-invertible function.

Many-to-One Transformation

Suppose T1(y) of each yRY consists of a finite or countably infinite set of points {Ti1(y)}, where Ti are differentiable. Then fY(y)=ifX(Ti1(y))|dTi1(y)dy|.

4 Quantile Transformation

We know c.d.f FX(x)=P(Xx). For u(0,1), the u quantile qX(u)R of FX is defined to satisfy FX(qX(u))=u, provided that it exists.
However, in many cases it does not exist. For example, XBernoulli(p), qX(1p) is not unique, and qX(u) does not exist for 0<u<1p.
To address these issues, define

Quantile Function

For u(0,1), define quantile function qX(u)=inf{xR|FX(x)u}.

For XBernoulli(p), qX(u)={0,0<u1p,1,1p<u<1.


Inverse Transform Sampling

Let UUniform(0,1).

  1. X either discrete or continuous, then qX(U)=dX.
  2. FX continuous, then FX(X)=dX.